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SUMMARY  PAGE 


THE  PROBLEM 

The  problem  of  operator  fatigue  and  its  possible  effects  in  re¬ 
ducing  the  detection  performance  of  the  man-machine  system  was 
investigated  during  the  course  of  a  129-min  simulated  sonar  watch. 


FINDINGS 

Successive  measurements  on  the  same  non-alerted  contact  taken 
43,  86  and  129  min  into  the  detection  period  showed  no  significant 
change  in  initial  detection  from  one  another,  nor  from  pretest  values 
taken  the  day  before.  These  results  indicate  that  under  conditions 
where  the  operator's  vigilance  is  maintained  by  a  not-unusual  fre¬ 
quency  of  contact  (operators  were  presented  six  contacts  at  random 
intervals  durii^  each  43  min-period),  and  where  operators  are  not 
aware  of  actual  elapsed  time,  no  change  in  operator  initial  detection 
performance  is  encountered. 

APPLICATION 

The  information  presented  in  this  report  will  be  useful  to  all 
personnel  involved  in  sonar  watchstanding  and  researchers  concerned 
with  sonar  operator  aural  detection. 
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ABSTRACT 


Experienced  sonar  operators  were  e3q)osed  to  conditions  of  simu¬ 
lated  sonar  watchstandii^  over  a  129-min  period.  Successive  meas¬ 
urements  on  the  same  non-alerted  contact  taken  every  43  min  during 
the  detection  period  showed  no  significant  change  in  initial  detection. 
These  results  indicate  that  under  conditions  where  the  operator’s 
vigilance  is  maintained  by  a  not-imusual  frequency  of  contact  (operators 
were  presented  six  contacts  at  random  intervals  during  each  43-mm 
period)  no  change  in  operator  initial  detection  performance  is  en¬ 
countered. 


Ill 


AURAL  DETECTION  PERFORMANCE  OVER  A  129  MINUTE 
SIMULATED  SONAR  WATCH 


INTRODUCTION 

In  the  realm  of  passive  sonar,  though 
numerous  types  of  semiautomatic  detec¬ 
tion  systems  have  been  explored,  sys¬ 
tems  employing  aural  detection  capabil¬ 
ities  of  the  human  operator  for  decision 
making  still  are  unsurpassed.  Granted 
that  such  performance  may  be  further 
optimized  with  various  methods  of 
multi-modal  or  encoded  signal  presen¬ 
tation,  the  fatigability  of  the  operator 
must  be  recognized  as  the  weakest  link. 
Theoretical  predictions  based  upon 
pure-tone  signal  detection  would  indi¬ 
cate  that,  at  least  from  an  auditory 
point  of  view,  the  ear  would  not  be 
fatigued  after  exposure  to  moderate 
level  tones  in  noise  for  periods  of  up¬ 
wards  of  2  hrs.  Still,  the  problem  of 
operator  fatigue  and  its  possible  effects 
of  reducing  the  detection  performance 
of  the  sonar  system  must  be  considered. 

Fatigue  can,  of  course,  be  an  overall 
encompassing  term.  Operators  can  be¬ 
come  ’’fatigued"  from  too  many  contacts 
(confusion)  or  too  few  (boredom) .  Eval¬ 
uation  of  such  performance  in  terms  of 
extremes  in  conditions  cannot  in  all 
cases  be  conducted  successfully  in  the 
laboratory  because  of  motivational  dif¬ 
ferences  between  "real  world"  and  ob-^ 
viously  contrived  experimental  situa¬ 
tions.  For  example,  while  under  actual 
shipboard  conditions  a  sonar  operator 
would  willingly  stand  watch  for  a  1  hr. 
period  during  which  no  contacts  were 
detected,  these  same  conditions  in  a 
laboratory  situation  would  obviously  not 
maintain  the  same  motivational  level. 


While  it  would  be  less  than  ideal  to 
have  a  trained  sonar  operator  partici¬ 
pate  in  an  experimental  situation  where 
he  is  presented  no  information  (con¬ 
tacts)  until  a  2-hr  period  has  elapsed, 
successive  measures  of  his  perform¬ 
ance  under  different  levels  of  contact 
density  would  be  of  definite  value  in 
predicting  time  limits  of  maximal  oper¬ 
ator  detection  performance. 

For  the  present  experiment  a  medi¬ 
um  contact  density  was  chosen,  six 
during  three  successive  43-min  ses¬ 
sions.  Under  these  conditions,  the 
same  stimulus  was  repeatedly  presented 
as  the  sixth  contact  of  each  session  and 
successive  measures  of  operator  per¬ 
formance  on  this  contact  were  taken. 

METHOD 

Subjects 

Eighteen  experienced  submarine  STs 
were  evaluated  in  the  present  study; 
eight  of  these  were  SSN,  seven  SSBN, 
and  three  SS,  all  sampled  from  oper¬ 
ating  ships. 

Procedure 

Operator  detection  performance  was 
collected  using  a  passive  sonar  simula¬ 
tor  developed  at  NUSC  (Fig;  1) .  The 
simulator  consisted  of  a  sonar  stack  or 
console  equipped  with  a  standard  hand- 
wheel  and  linked  to  a  specially  designed 
attenuator..  This  attenuator,  more  spe- 
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Fig.  1,  Block  Diagram  of  Passive  Sonar  Simulator  System 


cificallya  bearing  controlled  gate  (BCG), 
gradually  permitted  the  amplitude  of  the 
target  signal  to  rise  as  the  operator 
trained  the  handwheel  nearer  to  some 
"preset"  bearing  0-360“ .  Theory  of 
operation  of  the  BCG  circuit  is  available 
in  USL  Technical  Memo  1210-40-56. 

The  bearing  at  which  the  target  level 
reached  maximum  gain  could  be  selec¬ 
ted  by  the  experimenter  (E)  and  the  rate 
of  increase  in  target  amplitude  per  de¬ 


gree  bearing  was  S5rmmetrical  about 
that  point  such  that  an  equal  number  of 
degrees  on  either  side  of  the  selected 
bearing  would  produce  equal  levels  of 
target  attenuation.  Figure  2  shows  the 
actual  response  of  the  system  to  a  white 
noise  signal  fed  into  the  target  channel 
only,  with  a  "true"  bearing  of  40“  set  on 
the  control  synchro.  As  seen  in  the  fig¬ 
ure,  a  32-dB  attenuation  in  target  in¬ 
tensity  was  produced  symmetrically  36“ 
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Fig.  2.  Measured  Response  Characteristic  of  Sonar 

Simulator  Target  Channel  +  37^  from  “True’’ 
Bearing. 

on  either  side  of  "true"  bearing,  as  the 
operator's  handwheel  was  trained  over 
that  selected  bearing,  causing  the  target 
signal  to  rise  out  and  fall  back  into  the 
background  in  which  it  was  masked  over 
a  total  conduction  angle  of  72“  . 

At  constant  amplitude  from  0°-360° 
on  the  handwheel  was  a  background  sig¬ 
nal  into  which  the  target  was  mixed  ( 
(when  the  bearing  was  appropriate) .  A 
step  attenuator  on  the  target  input  per¬ 
mitted  the  level  of  the  target  to  be  ad¬ 
justed  to  some  level  X  dB  below  the 
background,  so  that  at  "true  bearing" 
the  maximum  target  signal  level  mixed 
with  the  background  noise  produced  a 
negative  ratio.  Meters  on  the 
equipment  allowed  E  to  monitor  the 
number  of  times  the  operator  swept 
across  the  target,  a  criterion  of  three 
sweep  passes  being  required  before  de¬ 
tection  was  considered  "missed"  and 
the  target  presented  to  the  operator  at 
the  next  easier  S/N  ratio.  An  accuracy 
of  +5“  was  required  for  the  detection  to 
be  considered  correct. 


Targets  and  background  channels  of 
the  sonar  simulator  were  fed  by  tape 
recorders,  Ampex  mixers  permittit^ 
various  tape  inputs  selected  by  E  to  be 
presented  over  the  target  channel  with¬ 
out  alerting  the  operator.  Table  1  pre¬ 
sents  the  schedule  of  target  presentation 
over  three  2 5-min  periods. 

Fifteen  different  stimuli  consisting 
of  five  tjTpes  of  complex  noise  were  ran¬ 
domly  arranged  within  this  schedule  and 
recorded  at  varying  rise  and  fall  times 
onto  standard  l/4-inch  recording  tape. 
These  stimuli  were  synthesized  to  be  of 
arbitrarily  chosen  spectral  character 
but  were  easily  distinguishable  by  the 
operators  into  five  categories.  A  sep¬ 
arate  channel  was  provided  with  time 
information  to  allow  E  to  preset  ran¬ 
domized  bearings  prior  to  the  onset  of 
the  contact  and  manipulate  their  SAl's. 

So  as  to  eliminate  any  possibility  that 
the  particular  sequence  of  contact  stim¬ 
uli  preceding  our  measurement  periods 
would  in  anjrway  bias  or  influence  per¬ 
formance  on  the  measurement  periods 
following  it,  the  order  of  sessions  A, 

B,  C  was  appropriately  counterbalanced* 
across  operators  and  each  was  presented 
followed  by  measures  of  operator  de¬ 
tection  performance,  the  latter  occupy¬ 
ing  17  to  18  min.  Figure  3  depicts  this 
schedule. 


*The  order  df  sessions  A,  B,  C,  were  arranged  such 
that  every  combination  of  the  3  was  exhausted 
(6:  ABC,  ACB,  BCA,  BAC,  CAB,  CBA).  Once 
averaged  over  our  18  operators  then,  an  equal 
number  tpould  have  heard  these  sessions  in  different 
order,  so  that  only  the  effects  of  successive  mea¬ 
surement  during  the  watch  would  be  capable  of 
affecting  performance. 
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Table  1.  Schedule  of  Contacts 


Contact  Duration  (min) 

Rise/Fall  (sec) 

Pause  Before  Next 
Contact  (sec) 

SESSION  A  - 

Total  Contact  Durations  22:0,  Pauses  310  :  Total  =  25  min 

Target  1 

6 

— 

60/90 

20 

Target  2 

3 

30/15 

10 

Target  3 

5 

30/60 

70 

Target  4 

5 

45/15 

80 

Target  5 

3 

0/15 

STOP 

SESSION  B  - 

Total  Contact  Durations  22:50,  Pauses  2:10  :  Total  =  25  min 

Target  1 

4:50 

30/20 

40 

Target  2 

5 

40/20 

20 

Target  3 

3 

60/60 

50 

Target  4 

6 

60/30 

20 

Target  5 

4 

20/20 

STOP 

SESSION  C  - 

Total  Contact  Durations  23:40,  Pauses  1:20  :  Total  =25  min 

Target  1 

4:30 

30/10 

0 

Target  2 

3 

40/20 

50 

Target  3 

6 

50/50 

20 

Target  4 

7 

0/40 

10 

Target  5 

3:10 

10/10 

STOP 
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Prerecorded  First  1 8  min  Prerecorded  25  Second  l8  min  Prerecorded  25’  Third  18  min 

25  min  session/  detection  period/  min  session/  detection  period/  min  session/  detection  period/ 


Elapsed  Time  43  min. 


Elapsed  Time  86  min. 


Elapsed  Time  129  min. 


F^.  3.  Schedule  for  Simulated  Sonar  Watch. 


Specific  Procedures  for  CollectiBg  Data 
During  Pretest  and  Measurement 
Periods. 


Subjects  were  individually  seated  at 
the  sonar  stack  console  and  asked  to 
report  bearing,  to  the  nearest  degree, 
of  a  target  presented  in  a  simulated 
ship  noise  back^ound. 


Target  signals  were  presented  below 
the  level  of  the  background,  creating 
appropriate  negative  S/N  ratios.*  Ini¬ 
tial  trials  on  each  target  were  presen¬ 
ted  with  the  target  masked  well  below 
operator  threshold  and  if  detection  was 
not  made  within  three  sweeps  across 
the  target,  the  trial  was  terminated, 
though  the  subject  was  not  informed  of 
any  termination  other  than  ’’please  con¬ 
tinue  search. "  The  experimenter  then 
raised  the  signal  level  of  the  target  by  2 
dB  (causing  a  lesser  negative  S/N 
ratio) ,  continuing  this  procedure  until 
the  operator  reported  his  first  accurate 
bearing  (+5®  accuracy).  When  a  con¬ 
tact  bearing  was  reported,  it  was  re¬ 
corded  along  with  the  S/N  ratio  and  the 
trial  terminated  though  the  search  was 
continued. 


*In  this  context  then  a  greater  S/N  would  imply  that 
the  target  level  was  further  decreased  in  the  back¬ 
ground  noise.  A  low  S/N  would  be  found  when  the 
target  level  is  nearly  as  loud  as  the  background. 


If  the  bearing  reported  was  accurate 
(+5®):  E  considered  the  trial  termin¬ 
ated,  bearing  was  randomly  changed, 
and  the  signal  level  of  the  target  was 
lowered  2  dB  (higher  S/N)  on  the  next 
trial.  If  the  bearing  reported  was  inac¬ 
curate;  the  trial  was  terminated,  target 
level  was  raised  2  dB  (lower  S/N) ,  and 
the  next  detection  trial  was  begun  at  the 
same  or  at  another  bearing. 


Criterion  was  either  2  accurate  de¬ 
tections  out  of  4  at  a  specific  S/N  (2/4 
=  50%  detection  probability)  or  2  accur¬ 
ate  detections  out  of  2  (2/2  ==  100%  de¬ 
tection  probability)  at  a  specific  S/N 
along  with  3  inaccurate  detections  (0/3 
or  1/4  =  <50%)  at  the  next  more  difficult 
S/N.  From  this  information  the  SN 
ratio  at  50%  detectability  was  derived. 
All  targets  were  presented  serially#  and 
tai^et  bearing,  although  otherwise 
random,  was  never  at  the  extreme  10® 
of  the  180®  sweep. 


The  criterion  of  not  more  than  three 
sweep  passes  during  a  trial  (automatic 
trial  termination  after  three  sweep 
passes  across  the  target)  was  employed 
since,  if  after  the  third  pass  the  oper¬ 
ator  had  failed  to  detect  the  target,  its 
level  was  assumed  below  the  50%  point 
of  detection  probability  and  the  next 


higher  S/N  level  should  be  presented. 
Using  this  procedure,  misses  and  false 
alarms  (incorrect  bearings)  are 
grouped.  This  we  believe  is  a  more 
realistic  assumption  since  under  pretest 
conditions  where  the  operator  knows 
that  a  target  is  always  present  (though 
at  times  below  threshold)  he  is  more 
likely  to  report  some  bearii^  rather 
than  to  report  no  contacts  at  the  termi¬ 
nation  of  his  third  sweep  across  the 
target. 

These  same  procedures  were  used 
durii^  the  18-min  measurement  ses¬ 
sions  the  following  day.  Operators 
were  given  no  indication  of  the  switch¬ 
over  from  the  prerecorded  25  min  ses¬ 
sion  to  the  18  min  evaluation  period,  E 
being  hidden  from  the  operator's  view. 
During  all  sessions,  contacts  were  con¬ 
firmed  or  negated  in  accordance  with 
their  presence  or  absence  at  the  re¬ 
ported  bearing.  During  the  129  min 
sonar  watch  it  was  requested  that  the 
operator  not  wear  a  wristwatch  and  no 
means  of  estimation  of  elapsed  time  was 
provided  (a  stopwatch  was  available  but 
only  for  turn  counting  purposes). 

RESULTS  AND  DISCUSSION 

Results  of  an  analysis  of  variance 
(repeated  measures)  showed  no  signifi¬ 
cant  change  in  target  detection  (p  <  .  75) 
after  elapsed  times  of  43,  86  and  129 
min.  Further,  no  significant  difference 
was  found  between  such  data  collected 
over  the  three  evaluation  periods  and 
that  collected  on  the  same  contact  the 
day  prior  to  watch  standing,  (p  <  .75). 
Operators  ranged  in  sonar  experience 
from  1  30:  to  11.5  yrs,  the  average  be¬ 
ing  4. 76  yrs  (standard  deviation  3.54 


yrs) .  A  Pearson  product  moment  cor¬ 
relation,  comparing  average  target  de¬ 
tection  of  each  operator  with  years  ex¬ 
perience  showed  it  not  different  from  0 
correlation  at  the  10%  level  of  confi¬ 
dence  (r  =  -.108),  (i.e.,  within  the 
limits  of  this  study,  the  more  experi¬ 
enced  operators  did  not  excel  in  target 
detection.) 

Such  results  indicate  that  under  con¬ 
ditions  where  operator  vigUance  is 
maintained  at  a  moderate  level,  opera¬ 
tor  initial  detection  performance  is  not 
degraded  over  a  2  hr  period.  It  should 
be  pointed  out,  however,  that  operators 
had  no  knowledge  of  elapsed  time  and 
perhaps  their  performance  would  have 
been  degraded  under  conditions  where 
such  information  was  available.  Fur*- 
ther,  the  lack  of  correlation  between 
years  experience  in  sonar  and  sonar 
detection  performance  is  common  find- 
ii^  indicating  that  at  least  in  initial  de¬ 
tection,  years  sonar  experience  is  not 
the  determining  factor . 

SUMMARY 

Eighteen  experienced  sonar  opera¬ 
tors,  when  exposed  to  conditions  of 
simulated  sonar  watch  over  a  129-min 
detection  period,  showed  no  significant 
change  in  target  detection  (p  <  .  75)  after 
elapsed  search  times  of  43,  86  and  129 
minutes.  Further,  no  significant  dif¬ 
ference  was  found  between  such  data  and 
that  collected  on  the  same  simulated 
contact  the  day  prior  to  watchstanding 
^  <  .  75).  Such  results  indicate  that 
under  conditions  where  operator  vigi¬ 
lance  is  maintained  (operators  were 
presented  six  contacts  at  random  inter¬ 
vals  during  each  43  min  segment)  oper- 
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ator  initial  detection  performance  is 
maintained  over  a  2  hr  period.  In  addi¬ 
tion,  no  correlation  (p  < .  10)  was  found 
between  an  operator's  months  of  sonar 
ejsperience  and  his  performance  aver¬ 
aged  across  the  three  measurement 
periods. 
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